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PREFACE 

BACKGROUND OF THIS STUDY 


The U. S, National Health Survey has a de- 
fined responsibility to collect survey data on the 
health of the population and on factors relating to 
health. Its survey program contemplates not a 
single method of data collection, but rather a va- 
riety of types of surveys, each differently de- 
signed according to the kind of data to be collect- 
ed and the sources from which such data can be 
obtained. 

Since valid and established methods do not 
exist for the collection of many needed types of 
health data the National Health Survey has addi- 
tional responsibility to conduct methodological 
studies directed to the design and continued im- 
provement of techniques for collecting such sta- 
tistics, In carrying out this function, it is aware 
that the development of successful research or 
survey procedures is an evolutionary process and 
may depend on the results of a number of separate 
studies. 

Most frequently in planning a new survey one 
relies largely on the literature and on readily 
available experience— making decisions on meth- 
ods to be used on the basis of such evidence as 
may be obtainable. Typically a survey is organ- 
ized on a tentative basis, pretested in one or more 
pilot studies, and then put into operation. But 
when feasible, it is appropriate to establish more 
formalized prior testing or experimentation with 
the proposed procedures of the projected survey. 
^ Each study may be expected to produce evidence 
pointing in some definite direction, and suggesting 


specific actions. The strength of those indications 
will vary of course from one situation to another; 
their evidence should be weighed accordingly 
along with other considerations bearing on the 
decision to be made. 

These points are emphasized, as a reminder 
that both this study and others which will be re- 
ported in this Series D of Health Statistics must 
usually be considered as steps toward an Im- 
proved modus operandi rather than conclusive 
solutions to the methodological problems involved. 
They are intended to be contributions to the nec- 
essarily gradual development of survey meth- 
odology utilizing differing techniques and data 
sources. 



Consideration has therefore been given to 
the development of a survey based not on an in- 
terview, but on a specially designed health ex- 
amination given to probability samples of the pop- 
ulation. Such an examination, for survey pur- 
poses, might include a very wide range of diag- 
nostic and test procedures or might be restricted 
to more limited areas of interest. Among many 
other points, the question arises as to the form 
of the medical-history-taking procedure used as 
a preliminary to a physical examination. The 
medical-history-taking procedure to be used would 
depend upon its effectiveness and reliability in a 
survey , in contrast to a therapeutic setting. 

Most medical histories are taken in a thera- 
peutic situation. In such cases the patient lias 
taken the initiative in seeking advice and care 
from a physician and the history-taking proce- 
dure can be curtailed or extended according to 
the judgment of the physician as pertinent facts 
about the patient's complaint are developed. 

In a survey setting the situation is quite dif- 
ferent. Here the examinees comprise probability 
samples of the populations and have not taken any 
initiative in seeking a survey physical examina- 
tion. Furthermore, the survey objective of com- 
piling a systematic picture of certain specified 
health characteristics of the surveyed population 
dictates that a certain degree of uniformity or 
standardization be imposed on the procedure. 

In these circumstances a number of questions 
arise about the character, arrangement, effec- 
tiveness, and reliability of different methods of 
taking medical histories. The study reported In 
this publication is a research project undertaken 
for the National Health Survey by the Survey Re- 
search Center to investigate some of these ques- 
tions. 

In defining the problem to be studied the Na- 
tional Health Survey formulated certain bound- 
aries or limitations to the scope of the investi- 


gation. These boundaries were determined largely 
by considerations relating to other factors in the 
whole design of a survey that would be based on 
health examinations. 

The following points determine the scope of 
this particular research project: 

1. In general terms, the objective of this 
study was to investigate certain specific ques- 
tions about the effectiveness and reliability of 
various methods and to make recommendations 
for a tentative questionnaire form and procedures 
to bo used. I he purpose was not to derive the 
full content and final form of a history-taking 
procedure to be used in a survey. 

2. The purpose of the history -taking pro- 
cedure to be developed was to obtain a maximum 
number of useful clues or indications, the nccu- 
lacy and significance of which could be evaluated 
subsequently by the examining physician. It was 
desired to develop a procedure which would re- 
sult in a saving of physician time. 

3. The survey objectives relate to present 
morbidity with no attention to family Illness or 
past illnesses except as they might he pertinent 
to current morbidity. 

4. The survey objectives are directed pri- 
marily to chronic conditions rather than to all 
Illnesses, and especially to heart disease, hyper- 
tension, diabetes, and rheumatism and arthritis, 
bor various reasons, the population group to be 
sampled was limited to adults. 

5. It was not expected that this preliminary 
Investigation of history-taking procedures would 
necessarily yield conclusive answers to the var- 
ious questions posed. The qualitative and quan- 
titative indications resulting from this study were 
to be studied further in a series of pretests of the 
whole health examination survey procedures. The 
final questionnaire form and methods of the med- 
ical-history aspect of this survey were to be a 
resultant of all of these steps. 
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A STUDY OF SPECIAL PURPOSE 
MEDICAL-HISTORY TECHNIQUES 


allowing research report was prepared by the Survey Research Center, Institute for Social Re- 
The University of Michigan, under a contract with the U. S. National Health Survey* Charles F. 
J h. D • , and Morris Axelrod, Ph. D., of the Institute for Social Research, directed the project 
'esponslble for the analysis and the report presented here. The methodology, findings, and con- 
are those of the Survey Research Center.) 


THE RESEARCH PROBLEM 


purpose of this report is to describe a 
ogical study preliminary to the develop - 
a medical -history questionnaire and ap- 
» interviewing techniques for use in a 
lamination survey of adults in general 
m samples. The research was con- 
iy the Survey Research Center of the 
ty of Michigan under contract with the 
tional Health Survey of the Public Health 


ives of the Study 

questionnaire to be developed was to be 
two general purposes: 

To obtain information about symptoms 
isses which would assist in arriving at 
Lc conclusions in physical examinations 
as included in survey samples, 

Together with the physical examination, 
i certain data for statistical analysis on 
jency of symptoms and illnesses and re- 
riables of a cross-section sample of the 
>n. 


This particular research study was not con- 
cerned with the full development, from beginning 
to end, of an all-purpose medical -hi story -ques- 
tionnaire form and procedure. Certain precon- 
ditions and limitations were given in advance, and 
certain special purposes defined. Further, the 
developmental work here described was to be 
preliminary to additional tests under actual health 
examination survey conditions and the final forms 
and procedures that might emerge were to be the 
resultant of all these steps. 

For the study reported here the National 
Health Survey posed several specific questions 
which served as the major objectives of the re- 
search, 

1, Will a general cross-section sample of 
respondents discuss their symptoms and illnesses 
when the interview is not initiated by them and 
when no medical help can be expected as a result, 

2, Is it possible to develop a fixed, stand- 
ardized questionnaire and interviewing techniques 
which are applicable to and understood by all 
respondents? It was ,not intended to develop a 



p, self-contained diagnostic instrument, 

ytlier an instrument which would save a phy- 
yfan time by providing consistent medical-his- 
/tory information. It was expected that the physi- 
cian would wish to amplify the history information 
during the examination. The question was whether 
a standardized history prior to the physical ex- 
amination would provide enough useful indications 
to justify its inclusion in a survey based primarily 
on physical examinations and clinical and physio- 
logical measurements. The fact that the data from 
the health examinations would be used to obtain 
statistical information on the frequency of ill- 
nesses and symptoms for the population would re- 
quire the use of standardized techniques through- 
out the examination including the history-taking 
procedures. 

3. If some form of medical-history-taking 
procedure provides a sufficient number of patho- 
logical indications to be apparently useful, are the 
reported symptoms and indications adequately 
reliable? In this context "reliable" is not used to 
mean accuracy but rather whether or not the re- 
sponses are consistent from time to time— re- 
flecting a stable situation or condition and not 
merely transitory or random answers. The sig- 
nificance of the responses can be subsequently 
judged when taken In conjunction with other data 
collected. 

4. Can nonmedical trained interviewers ob- 
tain as much information on disorders and symp- 
toms as nurses? It was thought that nurses, even 
if not in uniform, might obtain more complete in- 
formation from respondents than would trained 
lay Interviewers because the nurses’ greater 
medical knowledge and experience would enable 
them to understand respondents- statements. and 
to clarify the information reported. In addition, 
it was thought that uniformed nurses are per- 
ceived by the respondent 33 being well trained and 
able to understand medical problems; and that 
respondents, therefore, might feel freer to com- 


municate personal medical problems to them than 
to persons who are not nurses. On the other hand, 
since nonmedical trained interviewers are more 
readily available than nurses, there could be a 
more advantageous use made of the nurses' time 
if lay interviewers could obtain adequate infor- 
mation. 

5. What general type of questionnaire ob- 
tains the greatest amount of information? Three 
general types of questionnaire were considered 
to be appropriate for obtaining medical histories. 
'Two require the use of an interviewer mid the 
third is a self-administered form. If self-admin- 
istered questions could be used, it would result 
in saving considerable time and resources, A 
self-administered form can be administered in a 
shorter time than either of the questionnaires 
which require interviewers. In addition, the self- 
administered form does not require any partic- 
ular skill and training on the part of die adminis- 
trator. 

Two types of interviewer -administered forma 
were to be developed and tested: one using mainly 
open questions, the other mostly closed questions. 
Open questions require the respondent to relate 
his symptoms and Illnesses without specific 
prompting; closed questions comprise a checklist 
from which the respondent selects one of two or 
more choices which best represents his position. 

The open-question form is widely used in 
suivey research to obtain information of partic- 
ular Importance or relevance from the respond- 
ents’ point of view, Also, when the respondent 
talks freely about a topic, the researcher is able 
to see the Interrelationships of this topic with 
others, to see their Importance to the respondent, 
and generally to obtain some insight into the 
meaning and significance of the responses. On 
the other hand, the analysis of the open question 
is frequently difficult and time consuming. 

The closed question, presumably, yields a 
greater reported frequency of any particular 
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symptom since it reminds the respondent of 
things which he might not think to mention in the 
open question. The closed question gives specific 
yes and no answers and standardizes the proce- 
dure. Coding and analysis of the information is 
easier. 

Assumptions Underlying the Research 

As has already been mentioned, the purpose 
of this research project was not to design an in- 
strument which would by itself yield accurate 
medical diagnoses. It is assumed throughout this 
study that the objective is to obtain information 
which the respondent has, or thinks he has, about 
himself. Such information may be medically cor- 
rect or incorrect, significant or unimportant. 
The aim was to get as complete a history as pos- 
sible, leaving it to the physician to evaluate the 
responses. The criterion for success was the 
number of symptoms or the number of illnesses 
which the person reported. It is assumed that it 
is better to obtain false positives than false neg- 
atives. 

Ideally, the exploration of the various prob- 
lems should be carried out in such a way as to 
permit definitive statistical tests of significance. 
Such conclusive testing was not feasible because 
the low incidence of most symptoms and illnesses 
would require a sample much larger than was 
practical to arrive at proven conclusions. The 
final analysis is a compromise, combining both 
objective measures and subjective evaluation. 
The primary question, namely, whether a stand- 
ardized medical-history-taking procedure can be 


sufficiently useful to justify its inclusion in a 
health examination survey must remain largely a 
matter of judgment. 

The subject matter of the interviews, in- 
cluding the general topics to be included in the 
history, were not variables in this research and 
were specified in advance by the National Health 
Survey staff. The topics were selected to con- 
form to the objectives of a proposed special pur- 
pose health examination survey. The history was 
not meant to be complete, but to focus on certain 
clusters of diseases and symptoms. The primary 
focus was on heart disorders, hypertension, dia- 
betes, rheumatism and arthritis, and associated 
symptoms. 

Several separate types of investigations were 
conducted. The first was a series of develop- 
mental inteiwiews to derive a preliminary form 
and wording of the questions. About 125 inter- 
views were taken for this purpose. The second 
set of investigations consisted of experimental 
field trials including 224 interviews in which the 
various questionnaires, techniques of interview- 
ing, and types of interviewer were tested using 
overlapping samples. This report covers the 
series of developmental interviews and the ex- 
perimental field trials. 

Subsequent to the work described in this re- 
port, the findings and conclusions arrived at here 
formed the basis of a preliminary history form 
and procedure to be tested under actual survey 
conditions in a series of pretests of a survey 
operation based on medical examinations. The 
results of these pretests are not reported here. 


THE DEVELOPMENTAL INTERVIEWS 


Initially, a series of preliminary interviews 
were conducted for the purpose of developing 
three provisional questionnaires; an open-inter- 
view form, a closed -interview form, and a self- 


administered questionnaire. The development of 
these questionnaires served to provide answers to 
some of the more general problems being studied 
and the questionnaires were then utilized in testing 
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some of the specific hypotheses. A relatively 
crude set of questions was used at first to de- 
termine whether respondents would talk about 
their medical problems to nonmedical inter- 
viewers and as a first step in determining whether 
it was possible to standardize questions about 
symptoms and illnesses which most respondents 
would understand and accept. 

Six interviewers were employed in these de- 
velopmental interviews. All were well trained in 
interviewing techniques and had had several years' 
experience in survey interviewing. None had had 
previous experience in medical interviewing. A 
special training session was held to instruct them 
in the meaning of each question, and to provide 
definitions of the terms used in the questions. 

Following this training, a first round of 24 
interviews was arranged with each of the 6 inter- 
viewers taking four interviews with respondents 
of varying ages and educational, occupational, and 
income levels. An equal number of men and wom- 
en were interviewed. The interviewers were 
instructed to record verbatim any comments which 
indicated failure to understand the questions, any 
questions which respondents asked, or any other 
pertinent comments. In addition, interviewers 
were urged to experiment with different wording 
in an attempt to devise questions which better 
communicated the desired queries to the re- 
spondent. Whenever possible, interviewers asked 
the respondents to clarify their use of terms; 
whether the respondents understood particular 
words; and asked respondents who had symptoms 
how they would describe them, etc. 

Following this first round of interviews, con- 
ferences with the interviewers were held in which 
each question was analyzed to determine whether 
respondents readily understood the question, 
whether they could easily respond to it, whether 
they were embarrassed by it, and so fordi. On 
the basis of this first experience.lt seemed clear 
that it would be possible to develop a standard- 


ized series of special purpose medical-history- 
taking questions, and that survey respondents do 
not hesitate to answer such questions. In fact 
people seemed delighted to have the opportunity 
to talk about their symptoms and illnesses. The 
answer to the first question under study— namely, 
would people freely discuss their medical history 
in a situation in which they had not taken the ini- 
tiative in seeking medical care— seemed obvious. 
There were no apparent major barriers to ob- 
taining medical-history data for research pur- 
poses. Subsequent interviews sustained this gen- 
eral conclusion. 

It was also found that many of the preliminary 
questions were inadequate for the purpose for 
which they were intended. On the basis of the in- 
terviewers' comments and an analysis of the re- 
ports, a second draft of the set of questions was 
prepared which was used as the basis for another 
round of interviews. Again, Interviewers' com- 
ments and a tabulation of the Information which 
the interviewers obtained were studied, and again, 
questions were reworded and the order of ques- 
tions changed. This sequence of Interviewing and 
analysis continued until it was felt that each ques- 
tion met the objective for which it was devised, 
that each question was understood and accepted 
by virtually all respondents, and that the Inter- 
viewers felt a tease in using the completed sched- 
ule, In all, about 10 separate drafts were tested. 

The responses for the Inst three of these 
rounds of interviewing were tabulated to provide 
a frequency response for each question In order 
to give a clearer picture of the responses. 

Several times during the evaluation proce- 
dures, the questions were checked with physicians 
on the staff of the National I-lealth Survey and at 
the University of Michigan.* This process was 

♦Acknowledgment la made particularly for the 
assistance of Thomas Francis, Jr,, M, D. , Frederick 
Epatoin, Robert J.M* Horton, M.D,, Horace J. 

Dodge, M.D., and Charlos A, MeUner, Ph.D. of the 
School of Public Health, University of Michigan. 
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used to maintain an accurate medical orientation; 
and to be sure that the questions were obtaining 
the type of responses which might be of signifi- 
cance to an examining physician. 

Findings From the 
Developmental Interviews 

The series of developmental interviews re- 
sulted in a number of findings relating to ques- 
tionnaire formation and question sequence, pos- 
sibilities of standardization of medical -history 
forms for research purposes, and the character 
of respondents 1 replies. In the first round of in- 
terviews the questions followed a ’’logical 11 se- 
quence, asking first whether the respondent suf- 
fered from a particular illness and then whether 
he had symptoms associated with that illness. 
The first interviews showed that respondents had 
a tendency to develop a ’’set,” so that if they re- 
ported having an illness they tended to answer 
"yes” to symptoms which followed it in order to 
appear consistent. When symptom and illness 
questions were placed in different sections of the 
questionnaire, respondents seemed to respond to 
them more objectively or independently. Also, it 
was apparently easier for respondents to report 
on symptoms than on more complex illnesses. 
For these reasons, symptoms were put first in 
subsequent revisions of the questionnaires. 

For similar reasons, the ’’easy” or more 
common symptoms were placed at the beginning 
of the questionnaire. For example, headaches and 
nosebleeds were asked about before blood in urine 
or in bowel movement, since experience indicated 
that personal or sensitive questions should be 
asked only after the respondent has become used 
to the interviewer and the types of question which 
is being asked. 

At this stage, also, a set of follow -up or probe 
questions were developed which would describe 
more completely the symptoms and illnesses. It 


was hoped to identify the attributes which would 
be most meaningful to a physician and also to the 
respondent, but it was also important to include 
only attributes which respondents could report 
reliably. Many attributes were tested but, finally, 
four attributes were evolved as being most de- 
scriptive and medically significant for symptoms, 
and four for diseases. The symptom attributes 
and the probes for symptoms are shown below: 


Attributes of Symptoms 

1 . Frequency 

2. Intensity 

3. Attributed cause 

4. Description 


Symptom Attribute Probes 

Do you usually get (this 
symptom) every few days 
or not as often as that? 

Does It bother you just 
a little or qu i te a bit? 

Do you have any idea what 
causes this? 

Tell me, how it feels? 


In early drafts 3-point and 5-point measure- 
ment scales were used for the probes on frequency 
and intensity. However, a 2-point scale was found 
to be easy to use and meaningful to respondents; 
it readily differ entiated "serious” from less seri- 
ous symptoms for them. In most cases respond- 
ents were unable to make finer discriminations. 

The probes on attributed cause and descrip- 
tion did not always obtain revealing answers, but 
seemed sufficiently rewarding to be included. An 
example will illustrate the sequence of questions 
used for symptoms. 

Have you had backaches or pains In your back in 
the past few years? 

Q Yes Qno 

(If the response Is "Yes") 

Do you usually get these pains every few days 
or not as often as that? 

□ Every few days 0 Less often 

When you have these pains does It bother you just 
a l Ittle or quite a bit? 

ED Just a little Dqu Ite a bit 

Do you have any Idea what causes these pains? 

Tell me how it feels., 



The main question (e.g M Have you had back- 
aches or pains in your back in the pastfew years?) 
is worded, purposely, to be broadly inclusive, 
both with respect to time and in severity of symp- 
toms. This follows the assumption stated earlier 
that it is better to obtain false positives than false 
negatives. The probes which follow the main 
question help to describe more clearly the pos- 
sible significance of the symptom. 

In similar manner standard attributes for 
illnesses were evolved. These attributes and the 
probes used to investigate them are as follows; 


At t r 1 butes of I I I nesses 

1, Basis for response 

2. Professional or lay 
dl agnosis 

Symptoms 
4. Duration 


I I 1 nesses Attrl bute 
Probes 

What makes you think you 
have (this i I Iness ) ? 

Old a doctor tel ll you 
that you had ? 

In what ways does It 
bother or affect you? 

How long ago did you 
start having ? 


As in the symptom questions, the illness 
questions were asked in a very inclusive way. For 
example, for heart conditions there were two main 
questions; 

Do you have any reason to think that you may 
have any kind of heart trouble? 

Have you ever had any heart trouble? 

If either of these were answered affirma- 
tively the illness attribute probes were asked. 
For some illnesses other specific probes were 
included, such as questions on treatment, medi- 
cation, or diet where it was thought that the in- 
formation would be especially revealing. 

On the basis of the series of developmental 
interviews, three history-taking procedures and 
forms were developed for use in subsequent field 
trials to Investigate questions of the reliability 
and effectiveness of the different procedures and 
forms. These three questionnaires are; 

1. The closed-interview form — this questlon- 
naire comprises a series of specific ques- 


tions to be used as the basis of a struc- 
tured interview. Most of the questions 
could be answered by choosing an appro- 
priate response from alternatives sug- 
gested. For symptoms or illnesses re- 
ported, certain probe questions are asked, 

2. The self -administered form — this form is 
nearly identical in content to the closed- 
interview form and consists of a specific 
series of questions— the answers to which 
could be filled in by the respondent him- 
self, mostly by checking boxes for indi- 
cated alternative replies. As appropri- 
ate, additional check boxes relating to 
probe questions are to be used whenever 
the existence of symptoms or illnesses 
are checked, 

3. The open form — in the open form, instead 
of being asked questions about specific 
symptoms and illnesses the respondent is 
asked general questions giving him the op- 
portunity to mention spontaneously health 
conditions which bother him. As further 
stimuli, questions are asked which focus 
attention on various parts of the body* For 
each symptom or illness reported, the in- 
terviewer asks the probe questions used 
in the other two history -taking procedures. 

Conclusions From the 
Developmental Interviews 

In addition to the preparation of the three 
forms to be used in the studies of reliability and 
procedure, the developmental interviews contrib- 
uted some information to the main objectives of 
the study. One of the first objectives was to de- 
termine if a general group of respondents would 
discuss their symptoms and Illnesses for the pur- 
poses of co-operating in a research project as 
distinct from the purpose of seeking medical ad- 
vice and help from a physician. The develop- 
mental interviews indicated that there seemed to 
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10 obvious barriers to obtaining the co-opera - 
of respondents for such purposes. 

A second objective was to determine if it 
med feasible to develop and use a standard - 
1 medical -history -taking procedure for spec- 
d and limited research purposes that would be 
erstood by and applicable to a general cross- 


section group of respondents. The developmental 
interviews gave favorable indications that this was 
possible and that satisfactory responses could be 
obtained. 

These tentative conclusions were further sub- 
stantiated in the subsequent field trials. 


DESIGN OF EXPERIMENTAL FIELD TRIALS 


The three questionnaires prepared as a re- 
t of the developmental interviews were used as 
msisfor providing data to answer the questions 
ited earlier relating to (a) the reliability or 
nsistency of the obtained information, (b) the 
lative advantages of nurse interviewers and 
lined lay interviewers, and (c) the relative ef- 
itiveness of the self -administered, and inter - 
ewer -administered open and closed forms. 

It was decided that some type of experimental 
•sign would be better suited to testing the hypoth- 
ies and objectives of this study than a straight 
ross-section sample. It was desirable to use 
atched groups so that full advantage could be 
ken of the small samples for more adequate 
introl. It was also clear from the developmental 
iterviews that difficulties in interviewing, if they 
ere to occur, would be found more frequently in 
articular segments of the population. Specifically 
: was felt that the research design should include 
n overrepresentation of lower socioeconomic 
egments of the population as well as of those 
figments which might present cultural, language, 
ir literacy problems. These groups would find it 
nost difficult to understand the questions and to 
indthe best words to communicate their medical 
problems. 

The Interviewers 

Eight interviewers were selected, Four were 
;rained lay interviewers who had participated in 


the developmental interviewing and had had sev- 
eral years of interviewing experience on cross- 
section sample studies. Since it was desired to 
compare' interviews taken by nurses with those 
taken by trained lay interviewers, four nurses also 
were hired. Two of these nurses were in private 
duty, one was in industrial nursing, and one was a 
public health nurse. All had had a number of 
years of experience in their particular branches 
of nursing. As described below, for certain of the 
interviews the nurses were in uniform and foi 
others they wore "civilian 11 dress. The nurses 
were given a week's intensive training in inter- 
viewing principles and techniques. The intei- 
viewing techniques will not be described here 
since they have appeared in other sources.* In 
general the techniques are nondirective and the 
interviewers' probes nonbiasing. Such techniques 
are designed to obtain comparable data from re- 
spondent to respondent. 

After training, the four nurses were assigned 
to work on another study (not a medical study) to 
give them additional interviewing work so that 
their experience might be comparable in some 
degree to that of the trained lay interviewers. At 
the end of geveral weeks of such training and ac- 

, xll e techniques of Interviewing used In the 
survey ore described in the Survey Research Can* 
ter-s Monna i for Interviewers . More intensive de- 
scription of the theory and techniques qppeors in 
The Dynamics of Interviewing , by R.J.. Kahn, and 
C.F. Connell, Jbhn Wiley, 1947. 
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tuai interviewing experience, all eight interview- 
ers were brought together and given specific in- 
structions on the medical-history questionnaires. 
All interviewers took approximately four practice 
interviews on each of the three forms prior to any 
actual field work. These interviews were re- 
viewed by the research staff and were discussed 
with the interviewers. A final session was held In 
which problems of technique and question proce- 
dure were smoothed out. After this, the inter- 
viewers started on the field interviewing used in 
the analyses given in this report. 

The Sample 

Two settlement houses* and two housing proj- 
ects provided lists of their members between the 
ages of 25 and 65, designated by sex. The groups 
chosen represented widely divergent groups of 
nationalities and cultures. One group was in a 
relatively high-income area of Detroit and was 
selected in order to be sure that in attempts to 
word questions which could be understood by the 
lower socioeconomic groups, rapport would not 
be lost with the more highly educated segments of 
the population. 

As explained below, samples ^different sixes 
were used (or , he several different experimental 
designs. However, table 1 describes , he charac- 
er sties olihe total groupwhich was interviewed, 
education and occupation the group was con 

were somewhat older than , he average M ’ 

- Proportion ol uonwbites w .s repLe™;, 5 

Preliminary Steps 

h respondents describing ihe 
‘The Federation* of Setu 

' , "7 Metropolis Bn ‘ l Neighborhood 

l" getting sui table Ii sts of 0B,-<!ed to aa „ m 
ci «tion i a t of re «Pondents. A PDre 

‘hi» organisation,' Tr 

list, from ' assistance ip ob _ 

oouid be taken. he sa “Ple respondents 


raDie i 


rereent 


scrip Lion of group , 64 '’years*?? ^ 

usedin experimental field inte^S 


Description of group 


Race 


Total- 


White- 

Negt'o- 

Other- 


Kduca tion 


Total- 


Some high school or loss 

High school graduation or more 
Not ascertained 


Occupation 


Total- 


Operatives, clerical, sales--- 
Service workers and laborers-- 

HoubgwIvcb — . — - 

Others 




Total- 


Under 50---- 
50 and over- 


Sex 


Total- 


Male— - 
Female- 


M jjtltal status 
Total 

Single 

Married 

Widowed-- 

Divorced or separated----. 

%!l ker of children 
Total 


Percent 

distri- 

button 


100 


100 


100 


100 


100 


100 


None-- 


1 or 

10 

3 or more * , 

34 


56 


. clyancllelll ng 1)1 m that lie was selected nan part 
o random sample for this Interview. When the 
lewera nirived at the household, they intro- 



duced themselves and stated that they were from 
the Survey Research Center of the University of 
Michigan. They informed the respondents that they 
were conducting a study for the U.S. Public Health, 
Service for the purpose of finding out about the 
health of the population, and the types of physical 
problems people suffer from. They assured the 
respondents of anonymity, and informed them that 
their names were selected at random from lists 
of Community Center and housing project partic- 
ipants. Since the experimental designs called for 
reinterviewing, respondents were told at the con- 
clusion of the fiist interview that the interviewer 
would like to return in about a week and ask some 
more questions. It was explained that there were 
other points the Public Health Service wanted to 
investigate. 

At the beginning of the second interview re- 
spondents were told that some of the questions 
would be something like ones he had answered in 
the previous interview and some would be differ- 
ent. Most respondents were very co-operative 
and appeared to enjoy the interview. Only one re- 
spondent who gave the first interview refused to 
co-operate in the second although other second 
interviews were lost for other reasons. 

Design to Test the 

Effectiveness of the Questionnaires 

One important purpose of the field trial was 
to test the effectiveness of the three question- 
naire forms (open-interview, closed-interview, 
and self-administered) which resulted from the 
developmental interviews. The experimental de- 
sign should allow tests of the reliability or con- 
sistency of the results as well as the relative ef- 
ficiency of the different types of forms in eliciting 
diagnostic clues. It was considered to be ineffi- 
cient to assign each of the three forms to inde- 
pendent samples and then to attempt to compare 
the results to assay the differences. Many symp- 
toms and illnesses occur with such small fre- 


quencies that there would be very few cases of 
each. Instead, a design was made in which each 
respondent was interviewed twice, using different 
types of questionnaires. In this kind of design 
possible learning effects or boredom effects of 
reinterviews covering essentially the same infor- 
mation present a potential difficulty. Accordingly, 
although it was necessary to test three question- 
naire forms, it was considered not feasible to in- 
terview the same people three times. According- 
ly, the design provided that each respondent be in- 
terviewed twice with varying combinations of two 
of the thiee forms. In this way, a direct com- 
pailson of the results of two questionnaire forms 
used with the same people was possible. 

The first and second interviews were admin- 
istered a week to 10 days apart. In order to con- 
trol any educational or boredom effect which might 
exist, half of the respondents for each pair of 
questionnaires were given interviews using the 
two questionnaire forms in one order and the other 
half in the i everse order. For example, one group 
of lespondents was given the open-interview form 
and then a week later the closed -interview form; 
while another group was given the closed -inter- 
view form and a week later the open-interview 
form, and so forth. 

The lists of respondents were stratified by 
sex. Within each stratum respondents were se- 
lected at random. Each selected respondent was 
then randomly assigned a pair of two different 
forms. Since the design required the same num- 
ber of Interviews for each interviewer in each 
subgroup, interviewers were provided with alter- 
nate names in case the original person could not 
be interviewed. Also, if a person was interviewed 
once and could not be interviewed a second time, 
the first interview was discarded and a new name 

was selected for both a first and second inter- 
view, Of the original selections, 22 respondents 
were not interviewed, either because they could 
not be located or because they refused to be in- 
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terviewed. Tlie patterns of questionnaire assign- 
ment are shown in table 2. 

As table 2 indicates, the three combinations 
of paired forms and the same three combinations 
in reverse order were used in the interviews for 


a total of six patterns of questionnaire assign- 
ments. This design permitted a comparison of the 
information given by a respondent at two differ- 
ent times on two different questionnaire forms 


Table 2. Number of pairs of interview assignments by type of questionnaire* 

and interviewer 

4 Each pair consists of an i nterv i ew wi th ore type of questionnaire followed by another \ ntervl ew wi th the 

same respondent using another type of questionnaire) 


A. Nonmedical trained interviewers 


Interviewer 

number 

Total 

interviews 


Number of pairs 

of interviews 


| Type of questionnaire and order of use* 

A then B 

B then A 

A then C 

G then A 

B then C 

C then B 

1 

24 

2 

2 

2 

2 

2 

2 

2 

24 

2 

! 2 

2 

2 

2 

2 

3 

24 

2 

2 

2 

2 

2 

2 

4 

24 

2 

2 

2 

2 

2 

2 

Total 

96 

! 8 

8 

8 

8 

8 

8 


B. Nurse interviewers 


Nurse 

number 

Total 

inter- 

views 

Number of pairs of Interviews - not In uniform 

Inter- 

views 

with 

nurses in 
uniform 


Type of questionnaire and order of use* 



A then B 

B then A 

A then C 

C then A 

Hb then C 

C then B 

A 

1- ----- 

EH 

ms 

mtU ' H 


2 


2 

8 

2 





2 

jB^B^B 

2 

8 

3 





2 

- ftv 

2 

8 

4 



mmmM 


2 

:V«B 

2 

8 

Total 

96 

8 

8 

8 

8 

8 

8 

32 


*Type. of questionnaire:: 


IA] closed Interview, iB) se 1 f-adml ni stered, (C) open interview 


Design to Compare Interviews 
of Nonmedical Trained 
Interviewers and Nurses 

Another major objective of this study was to 
compare the results of interviews taken by nurses 
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not in uniform and by nonmedical trained inter- 
viewers. To make this comparison the design 
just described was extended to include the two 
types of interviewers. The sample of names from 
each settlement house was divided into random 
halves, one half being assigned to the trained lay 

















are subsequently evaluated. This second step 
cannot be taken, however, unless the clues pro- 
vided to the physician have a satisfactory degree 
of consistency or reliability. 

Questions of reliability can be examined in 
this study in several ways. In the first place 
since the self -administered and the closed-inter- 
view forms have similar questions, comparisons 
can be made between the results of these two 
forms after successive use with the same group 
of people, A different and more rigorous type of 
evaluation can he made by comparing the reports 
contained in two forms, item by item, for the same 
individual. 

Comparison of 

First Questionnaire Administration 
With Second Administration 

The first analysis made was a comparison of 
the results of the first and second reports of 
symptoms and disorders. Each respondent re- 
ported twice, the interviews being administered 
about a week apart. 

This section deals with interviews using both 
the self-administered and the closed-interview 
form. The questions in the two forms were iden- 
ticalfor mostitems. In half of the cases reported, 
the self-admini6tered form was administered 
first, followed by the closed-interview procedure. 
In the other half, the closed Interview came first, 
and the self-administered form second. 

There were two questions to be answered by 
this analysis. The first question was, is there 
evidence of a general educational or "interview" 
effect in the second report? It is sometimes 
found in survey research that panel studies de- 
velop biases because of repeated interviews. One 
reason for this bias seems to be that respondents 
learn from the first interviews, or at least are 
sensitized by the first exposure, and report dif- 
ferently in the second interview. It was expected 


that in later analyses all of the data could be com- 
bined from all self-administered and all closed- 
interview forms regardless of whether they were 
administered first or second in the series. This 
could be done only if there were no evidence that 
the first response seriously affected the second 
The second question to be answered by this analy- 
sis relates to the general reliability, or consist- 
ency of reports. 

Table 5 shows the number of types of symp- 
toms and illnesses reported by 64 respondents for 
the first administration and by the same 64 re- 
spondents for the second administration. Although 
both first and second reports are from the same 
respondents, each administration is based half on 
self -administered forms and half on closed-inter- 
view forms. Symptoms are grouped according to 
the illness to which they are possibly related ac- 
cording to medical judgment. Grouping in broad 


Table 5. Comparison of average number of 
reported symptoms or diseases per re- 
spondent obtained in first and second 
administration* 


Symptom or disease 

Average number of 
reported symptoms 
or diseases per 
respondent 

First 

adminis- 

tration 

Second 

adminis- 

tration 

Possible heart dis- 
ease symptoms 

1.7 

1*5 

Possible hyperten- 
sion symptoms 

0 .9 

, 1*0 

Possible rheumatism 
and arthritis 
symptoms 

1.6 

1*5 

Miscellaneous symp- 

toms 

1.1 

1,0 

Childhood diseases- 

2,8 

3.0 

Miscellaneous di's- 
eases 

1*2 

1.2 


Sixty-four respondents In each administration; 
one half of both administrations were self admin- 
fs ered, the other half were closed interviews/ 
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be one to show the lowest reliability. Probably 
for the layman this illness is not well defined. 
Respondents, being unsure of their own condition, 
tend to show greater variation in reports from 
one time to another. 

Table 7 shows the comparisons according to 
the same type of index computed for reported 
symptoms. In this table there is a greater vari- 
ability in agreement between the two reports than 
for illnesses, Atone extreme, for swollen ankles, 
the agreement is perfect; while at the other ex- 
treme, for backaches, the index of agreement is 
6.2 or only about 60 percent. 

There are various possible explanations for 
the differences. With the exception of headaches, 
there appears to be direct relationship between 
the level of reported frequencies of the symptom 
and the stability of the report as indicated by the 
index of agreement. Swollen ankles and trouble 
in breathing show the greatest stability and the 
lowest incidences. Backaches and joint pains have 
the largest variability and the highest incidence. 
Since the index used takes account of consistent 
negative responses as well as consistent positive 
responses, the numerical value of the index is 
partly dependent on the prevalence of the symptom 
or disease. Accordingly, the differences may 
partially reflect merely the differences in prev- 
alence. However, other reasons may explain 
some of the variability. The symptoms which 
showed greatest variability tend to be transitory 
and minor. Either they may not be painful or they 
may not be psychologically disturbing because of 
the respondents' perceptions that they do not im- 
ply serious medical problems. In these question- 
naires, respondents were told to report a symp- 
tom no matter how slight or infrequent. As a re- 
sult if a person had had a mild backache just be- 
fore one interview he may have reported it, but 
he may have forgotten it by the next interview It 
is also characteristic that the symptoms reported 
with higher reliability were more clearly defined 


Table 7. Index of agreement of closed-in* 
tervlcw and If- admin littered form f 0 J 
symptom*; for the name respondents 


(Number of per anna « 3 2) 


Symptom 

Total 

number 

of 

pe rmmn 
report- 

symptom 

on 

either 

forms 

Index of 
agreement 
between 
the two 
forms 

Swollen anklet*"---- 

5 

10,0 

Headaches 

2.9 

9.1 

Trouble breathing-- 

t\ 

9.1 

Nosebleeds - 

tl 

8,8 

Chest or heart 



pa In a — 

9 

8.8 

Joints swelling 

5 

8,8 

Heart acts Tunny--- 

13 

8.1 

Noises In ears * 

12 

7,8 

Leg cramps and 



pains 

111 

7,5 

Joint stiffness- 

13 

6,9 

Joint pains 

21 

6.9 

Backaches — 

23 

6.2 


NOllo THo fol I owl mj IllustnUo Iho typo of 
questions which worn mi tlm r«nl r acfmlnls- 

oro ^ and closed qutnil hmmii ni rojpmllmi symptoms. 


At any time ovor thu past, yours Juivn you hod 
any pa! no or soroooss in your joints^ 

[H H iV] 

Uo you ovor hnvo I’ltlim or onuii|m in your logs? 

O'i ['">] [.‘] 

Id the |>ani few ynnrt) Itavo you hail any pains, 
discomfort, or Iroulilo in or around your heart? 

[yoo] [„o] [V] 

Each positive rospoimo 1 1\ fol lowod with the 
following p rob on. 

How often? [fvory few dnyii] [lo.sii often] 

Do they bother 

' you? [Quito a hit] [just a little] 


One can observe swollen ankles and nosebleeds, 

wheieas joint pains or backaches are more sub- 
jective. 
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Reliability of 

Reported Severity of Symptoms 


Table 8, Index of agreement of severity 
and frequency of four common synptu:::* 
using three degrees of severity- and 
three degrees of frequency** 


Up to this point only the reliability of the re- 
spondent' s report of the presence or absence of a 
disease condition or symptom lias been considered. 
Each person reporting a symptom was asked also 
about the frequency of occurrence and the degree 
to which the symptom bothered him. The probe 
questions were: "Do you have this every few days 
or not as often as that?" and, "Does it bother you 

just a little or quite a bit?" 

"Pablo 8 shows the agreement index for the 
severity of the symptom. Four common symp- 
toms are used in this comparison. The index is a 
measure of the degree of consistency with which 
people place themselves in the same category 
from one interview to the next. To be consistent 
the respondent had to give the same response 
twice; either he did not have the symptom, he had 
it and it bothered him only a little, or he had it 
and it bothered him a good deal. It could be ex- 
pected that this index of agreement would be lower 
than that reported in table 7 since there is the 
possibility of one more degree of inconsistency. 

In general' this turns out to be the case. For 
noises in the ears the agreement remains essen- 
tially the same; for the other symptoms it is sub- 
Btantially lower* 

The last column of table 8 shows the same 
computations for three levels of frequency of 
symptoms. The respondent does not have the 
symptom, he has the symptom only occasion' y, 
or he has the symptom frequently. The level of 
agreement is generally consistent with information 
on the severity just reported. 

One further computation was made foi these 
same symptoms. Since respondents were en- 
couraged to report the presence of a symptom no 
matter how minor, it is not surprising that t e 
reliability of report was lower than for Illnesses 
which may be expected to be more clearly defined. 



Severity 

Frequency 

Symptom 

of 

of 


symptom 

symp tom 

Backaches | 

1 s -° 

6,2 

Headaches 

6.6 

7 .2 

Joint pains 

5.6 

5.9 

-j o 

Noises in ears 

7 .5 

7 .2 


*(li Symptom bothers quite a bit, 12) just a 
l ittle, 131 never. 

**(!) Symptom occurs every fev/ days, I*;) 
often, (3) never. 


Table 9* Index of agreement of severity 
and frequency of four common symptoms 
using two degrees of severity* and two 
degrees of frequency** 


Symptom 

Severity 

of 

symptom 

Frequency 

of 

symp tom 

Backaches — 

7.5 I 
7.2 1 
8.1 

9.4 

7 .8 

Headaches 

8.4 

Joint pains 

Noises in ears 

9.4 

9.1 

* ( | ) Symptom bothers 

quite a bit, 

r 121 just a 


little or never. 

**U) Symptom occurs every few days, 121 


often or never. 


herefore the index of agreement was computed 
)r only those symptoms which the respondent re- 
orted as occurring frequently or which caused 
considerable bother. Those reported as occuiring 
frequently and as bothering only slightly were 
combined with the "no" responses. Table? . a-t 
,n this computation, shows that the leve s o 
igreement are generally higher than chose seen 
Lntabie 7, which reported merely the presence or 
absence of the symptom. The reliability com- 
pares favorably with the reliability of illnesses 

seen in table 6. 
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The significance of these findings for a health 
survey is primarily a medical one. The reliability 
of report on symptoms can be increased by asking 
only for serious or frequent symptoms. On the 
other hand, by thus limiting the questions many 
symptoms will not be reported, and these may 
have important medical meanings. It may be 
concluded that information on symptoms should be 
asked in a general way, using the information 
gained by the probes to assist the physician in de- 
termining their significance. 


Conclusions on Reliability 

reports im.de « IW u> lWj ^ 
opart Hliowwt u rt l.Hiv. lv lil K |, liq , roo ()f 
ity, even with different nvli.ili, net. of data colI ec .' 

tion. Reports .... lit were quite reliable' 

For symptoms, reliability showed greater varla' 
biliiy, with Homo symptoms showing qU i t0 , mUe 
liability. There isevidenre that serious symptoms 
and symptoms with pl.ynloal signs wore reported 
with a higher degree of reliability limn otltcrs. 


COMPARISON OF INTERVIEWS TAKEN BY NURSES 
AND NONMEDICAL TRAINED INTERVIEWERS 


J DU 

was to find out whether the medical history co 

be obtained more adequately by nurses than by ik 

medical trained interviewers. The test was ii 

portant for the practical reason that nonmedl, 

trained interviewers would presumably be me 

available in the field situations throughout t 

country if surveys involving health examinatio 

were to be conducted at a large number of site 

In addition, in an examining situation there cot 

be a saving of the nurses' time if the history ta: 

mg could be done by persons other than the nurse 

A subsidiary question was whether nurses, dress, 

m their professional uniforms, would constitu 

more effective interviewers than nurses not 
uniform, L 

“ Was feU ,tat »«« might obtain mo: 

t : ::rr tor ,he 

• rses> because of their medical trainim 
might be able to understand better th 

rep ° 2 r,ed ■" ^ 

ReSp ° ndentSmi ght feel freer to talkahn, 
their medical problems with k bou 

per S o„s W howere„otnur e r hanWitl 
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The experimental design to lest these ques- 
tions luts been described earlie r, and tu. been 
mentioned, four imrueM were trained i n inter- 
viewing tedmlqtien mid lit the iidminlHtriUion of 
medical-history questionnaires, The compari- 
sons reported below m e for flnil lmerviewa token 
with the closed -inter view form by lay Interview, 
era, by nurses in civilian dress, and liy iiuracH In 
uniform, Tlte quest tons were not explored with 
reference to the open-interview ami the Helf-ad- 
mlnlstored forms. 

inble 1() is based on the reported symptoms 
showed the highest over -a 1 1 frequencies, 
pondenta were nuked whether they ever had 

| 10 Sympl0,u; l,IOHO who reported that they did 
iave it were naked whether they had the symptom 

ry fCW Clnys or 1101 H « frequently, 'litis table 
summarizes the results obtained from these two 

? 10118 Ru Cour symptoniH of greatest over-all 

frequency. 


ntei viewed by each type of JntervleWe 
" °“ n re l»rWln frequenclOH rnthortl 

percentages. 

n C * Qta ln Cn ^ e show no evidence 

i either in uniform or not, obtained It 



lie 10. Comparison of frequency of specific symptoms of interviewers, nurses, and 
' mi men In uniform cm closed- interviewer form 


■T Hi nts stif f 


Interviewers 

- 

Nurses in uniform 

Joint: iminn. 

Interviewers 

Nurses--- _ 

Nurse fi in uniform----- 

Joint swel ling 

Interviewers 

Nurses 

Nurses in uniform 

Backac hes 


Interviewers 

Nurses 

Nurses in uniform 



Number of 
lnt.ervi.ewB 

Never' has 
symptom 

Has symptom 
less often 
than every 
few days 

Has symptom 
every few 
days 


:i2 

24 

5 

3 

- - 

32 

22 

6 

4 

“ - 

32 

28 

2 

2 


32 

18 

13 

1 

, — « 

32 

15 

15 

2 


n 

18 

9 

5 


32 

25 

6 

1 


32 

28 

2 

2 

--- 

32 

29 

2 

1 


32 

10 

19 

3 


32 

15 

15 

2 

--- 

32 

14 

15 

3 


frequencies of symptoms ihun did Itty interview- 
era, There Ih o slight Indicuilou tlun the rcverim 
1 b true, 

If the four symptom reported are added to- 
gether, the numbers reporting positive sympioms 
are greatest for the lay Interviewers, next for 
nurses not in uniform, and leant for nurses in 
uniform. The numbers are not large enough to 
exclude the possibility that the observed differ- 
ences ure a result of chance. In any event, there 
is no evidence that nurses, or nurses In uniform 
obtain better results than lay Interviewers. As 
may be seen by adding the figures for the differ- 
ent symptoms In table 10, n total of 51 symptoms 
were reported to interviewers, *18 to nurses, and 
39 to nurses in uniform. 

Table 11 la a summary of die number of all 
reported symptoms grouped Into four main types. 


The body of the table gives the frequency distri- 
bution of interviews by the number of symptoms 
of elicit type reported for the three classifications 
of interviewers. The last column shows the aver- 
age number of each type of symptom obtained. 
As lit table 10, nurses did not obtain a greater 
frequency of symptoms than did the lay inter- 
viewers. Again It Is seen that the data indicate 
that there la a tendency for lay interviewers to 
obtain the greatest number of symptoms, and for 
nurses in uniform to obtain the smallest number. 
The average frequency for all four types of symp- 
toms together is ns follows: 

Lay interviewers 5.0 
Nurses 4 * 7 

Nurses in uniform 3.8 
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Table 11. Comparison of lay interviewers , nurses, and nurses in uniform according t 0 

number of reported symptoms by type 



Number of 
interviews 

Frequency distribu- 
tion of interviews 
by number of symp- 
toms reported 

Average 
number of 
symptoms per 
interview 

Rheumatic and arthritic symptoms 


0 

1 

2 

3 

4 

5 

6 



Nurses 

Nurses in uniform — 

32 

32 

32 

5 

6 
9 

11 

12 

12 

10 

7 

7 

4 

5 
3 

2 

2 

1 




1.6 

1.5 

1.2 

Hypertension symptoms 











Interviewers 

Nurses - 

Nurses in uniform 

32 

32 

32 

19 

13 

22 

8 

16 

10 

4 

3 i 

1 





0.6 

0.6 

0.3 

Heart symptoms 











Interviewers 

Nurses 

Nurses in uniform . 

32 

32 

32 

9 

11 

9 

7 

7 

11 

6 

3 

9 

7 

8 

2 

2 

3 

1 

1 


1.7 

1.5 

1.2 

Miscellaneous symptoms 











Interviewers 

Nurses- 

Nurses in uniform 

32 

32 

32 ] 

LI 

L3 

L4 

12 

9 

9 

6 

4 

5 

2 

5 

4 

1 

1 

— 



1.1 

1.1 

1.0 


Table 12 shows the respondents' reports on 
questions relating to various selected illnesses 
which would be of importance in health surveys 
based on medical examinations. Because the fre- 
quency of these illnesses is very low in the small 
number of interviews available no definite con- 
clusions can be drawn. They are presented, how- 
ever. to show thatthereis no evidencethat nurses 
obtamed reports of higher frequency of illnesses 
than did the interviewers who were not nurses. 


Conclusions on 
Comparison of Nurses and 
Nonmedical Trained Interviewers 

The hypothesis that nurses would obtain! 
reports of symptoms and illnesses than would 
medical trained interviewers was not su Ppo 
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On the contrary, the evidence although not defini- 
tive, suggests that lay interviewers may have ob- 
tained a greater volume of reported conditions 
than did nurses. 

Iheieis no evidence that the medical training 
Of the nurses was important in obtaining more 
meaningful reports. Respondents tended to talk 
about their symptoms and illnesses in nonmedical 
rmsieadily understood by the nonmedical train- 
ed interviewers. The occasional exception oc- 
curred when the respondent reported a diagnosis 
using the technical name given his illness by Ills 
P ysician. This use of technical terms was more 
evident in reporting prescribed medications, in- 
terviewers had more difficulty spelling the names 
° dru S s - orations, and illnesses than did nurses. 

problem was particularly apparent since re- 
spondents frequently misremembered these tech- 


. lA ,2 Comparison of lay interviewers, 
nurses,’ and nuraae in uniform on report- 
ed incidence of H|>««ific LIIuohh his- 
tory 



meal terms and could not report accurately. The 
nurses were more likely to know the correct name. 

One other difference relevant to a decision 
as to whether or not to use medical trained inter- 
viewer h was evident in the training period. It 
wan found that persons who were not medically 
trained could be trained as interviewers in a 
shorter time than could nurses. The reason lies 
in the particular attitude or "set" with which the 
two groups approached the interview. The non- 
medical trained interviewers were easily trained 
to accept the objective of obtaining the best report 
which the respondent could give of bis medical 
situation, without concern as to whether the re- 
port was medically significant or correct. The 
nurses, because of their greater medical sophis- 
tication, found it difficult at first to accept this 
limited objective. Presumably they felt under 
pressure to Interpret the responses, to look for 
the medical significance. It may be that the nurses 
were concerned that merely reporting what the 
.respondents said, in the naive terminology used, 
would imply alack of medical sophistication on the 
nurses* part. In general, then, whereas Inter- 
viewers were content to report merely what the 
respondent said, and could keep their attention 
focused on die techniques required to obtain the 
data, llie nurses bad greater need to attend to the 
medical content of the interview. For this type of 
Interview, training in interviewing technique, par- 
ticularly in probing for complete responses, is 
more importune than medical training. 

•Hie somewhat higher frequencies obtained by 
the lay Interviewer may reflect longer experience 
hi this type of Interviewing and does not imply 
that nurses could not, with more training and ex- 
perience, do as satisfactory a job. 

The tendency for nurses in uniform to obtain 
a lower frequency of symptoms and illnesses than 
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nonuniformed nurses could not be interpreted in 
the same way since the same nurses took inter- 
views in uniform and in civilian dress, The train- 
ing and experience was therefore the same for 

both sets of interviews, 

r Ilie "nurses in uniform" part of the design 
was included to test the hypothesis that respond- 


ents would feel freer to discuss their medical 
problems with persons who were obviously identi- 
fied as nurses. Clearly the data indicate that the 
nurses in uniform did not obtain more information, 
and, although the differences are small and may 
be due to sampling error, there is some indication 
that they obtained less. 


EFFECTIVENESS OF THE OPEN INTERVIEW 


There are basically two kinds of questions 
which are used to obtain information. One is the 
"closed question" in which the respondent is asked 
about one specific item of information and re- 
sponds simply with a "yes" or "no" answer, or 
along some dimension specified in the question. 
The second type is the "open question" in which 
the lespondent is asked a question requiring him 
to frame his own response. An example of each 
type will clarify the difference. 

Closed question: Did you have measles when you 

were a child? Q y es \J No 

(Repeat for other childhood 
1 I I nesses ) 

questio H : What illnesses or diseases did 

you have when you were a 
ch I I d ? 

Generally itis believed that the open-question 
approach has the advantage of obtaining infor- 
mation which is salient and which is important to 
the respondent. Further, as the respondent dis- 
cusses the question he provides the interviewer 
(and indirectly the researcher) with greater in- 
sight into the implications of the topic. So, for 
example, it could be predicted that an open ques- 
tion on symptoms would elicit those symptoms 
which were more painful or worrisome, or which 
bothered the respondent most frequently. It could 
also be anticipated that the open form might yield 
a greater variety of symptoms, since the closed 
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form is limited to the symptoms listed. The open 
form could be expected to yield a better under- 
standing of the origin and history of the symptom 
and more insight into its significance for the re- 
spondent. In spite of this, however, the over-all 
frequency of reported symptoms would be ex- 
pected to be lower in the open form chan in tire 
closed form. 

The open form of the questionnaire developed 
for this study started with a general question about 
symptoms. To assist the respondent to recall 
his symptoms, the general question is followed 
by subquestions focusing on various parts of the 
body. For each symptom reported standard probes 
were used to determine intensity, duration, and 
attributed cause. Similar series of open questions 
were asked about illnesses. 

The results of the interviews generally con- 
filmed the hypothesis that the total frequency 
would be lower for the open form. Every symp- 
tom asked about on the closed form was reported 
with greatly reduced frequency in the open form. 
For example, taking four common symptoms from 
the closed questionnaire the findings were as fol- 
lows; 

J oint painB — frequency on open question one 
half of frequency on closed ques- 
tion 

J oint s tiffness— frequency on open question 
one fourth of frequency on 
closed question 



Heac taclicH — frequency t>n open question oik; 

half of frequency on dosed ques- 
tion 

N oIhch In wirm “-frequency on open question 
one lilt 1 1 of frequency oil 
closed qiu'tiiion 

In the open form, a connidernlily higher pro- 
portion of persons reported ilmi the symptoms 
bothered Ilium frequently niul with greater inten- 
sity than in the elonetl I'neiii. Il appears from 
these data that rospomlimls reported the symptoms 
and Illnesses which emitted them moot concern in 
terms of IntoiwiRy or frequency of occurrence, 
Even tlumidi the* questions in lioili forum were in- 
tended to obtain the tmine level of riymplomu, the 
respondents' Interpretation of the quest Ions wan 
different. It appears ilml the open qiiesilou elic- 
ited Information not about all nyniploms Inti about 
ayinptoms which "hothereil" respondents nl the 
time. 

'lltuforin of the question should then he guided 
by the type of Information denlmi, l ; or obtaining 
Information ahtnii the medical problems which 
are of most: Importance to the respondent, or 
which bother him, the open quest ion is preferable. 
If information about tlie frequency of all symp- 
toms, even those which nre Infretiuent or only 
mildly trouhlenome, In in be obtained, a question 
specifically unking aliout the Hytiqitoin seems 
necessary. 

It is Interest I up, to note that symptoms which 
bother the respondent must may not lie those which 
nre most significant from a medical statulpolnt. 
Por example, one respondent who hml a diagnosed 
heartcoudltlon of some gravity reported this only 
after some probing, ills first concern was n per- 
sistent case of athlete's fool which caused him 
considerable annoyance and discomfort, 

Many symptoms and disorders were reported 
on the open form which were not asked about in 
the closed form, For example, a higher incidence 
of digestive and respiratory symptoms was re- 


pented in the open form. This finding is explained 
partly because the history forms being tested 
were not intended to be a complete review of all 
symptoms. 

There was great variation in the number of 
symptoms and disorders reported in the open 
form. Some respondents reported almost no prob- 
lems on die open form and several on the closed. 
Others reported nearly the same number on both 
forms. In addition to the analysis of the interview 
protocol, studies were made of recorded inter- 
views, From these recordings, one other char- 
acteristic seemed to stand out. People tended to 
perceive themselves as being healthy or sickly. 
Tills self-perception appeared to be reflected in 
die number of tilings which people reported as 
being wrong with them. Some respondents made 
such comments as; "I'm never sick." "I haven't 
lieento a doctor in 16 years," "I have a few things 
but nothing to complain about. I'm really very 
healthy." Others snid, "I have a lot of things 
wrong with me. Seems like I'm bad off most of 
the time," or "Well, if you've got an hour I'll tell 
you some of my troubles— I've got plenty!" or "I 
haven't had a day without something wrong with 
me for 10 years. My doctor says I'm neurotic and 
probably 1 am, but I've got pains just the same," 

It would appear that the self-perception of 
being healthy or sickly provided the basis for the 
respondent's report. If lie perceived himself as 
healthy and took pride in this health, he tended to 
underreport Ills problems. If he perceived him- 
self as sick lie tended to report more fully, or 
perhaps ovorreport. Characteristically, the per- 
son who reported being very healthy and having 
no problems did report some symptoms or ill- 
nesses in response to added probing by the inter- 
viewer. It is impossible to say whether all con- 
ditions were reported. 

One of the major advantages of the open ques- 
tion was that as the respondent told the story of 
his problems in his own way he gave more infor- 
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mation about his problems than he could commu- 
nicate by means of the closed questionnaire alone, 
For example, he frequently gave the history of the 
problem, told how various symptoms seemed to 
be related, how they affected him, and what type 
of treatment he used. This background informa- 
tion provided a better basis fox understanding the 
problem than a simple report of its presence. A 
few examplesfrom interviews will illustrate this; 

"I get pains in my abdomen once in a while 
that bother me quite a bit, A couple years ago I 
had a job where 1 had to carry a big heavy tool 
box. Now I have an ache down there. Think maybe 
I got a little rupture and one of these days I'll take 
sick leave and go have a checkup and see what 
alls me," 

Sometimes 1 get a tightness and pain around 
the heart. In the pastfour months I've had it quite 
often, every day or two. It’s a real sharp pain in 
the middle of my back. In fact it will actually 
kink up and I have to wriggle to get straightened 
out. I think it’s caused by standing over a table. 
I'm a draftsman and stand at a table all day long," 

Conclusions on the 

Effectiveness of the Open Interview 

The open questionnaire obtained considerably 
fewer reports of symptoms and disorders than did 
the closed questionnaire. In die open question- 
naire, problems which seemed to bother the re- 
spondent most were reported with greatest fre- 
quency but such problems were not necessarily 
the only ones of major concern in a general health 


survey* Greater information on the background of 
the problem was obtained from the open question- 
naire. On the other hand, to obtain quantitative 
measures of frequency specific questions calling 
for positive or negative replies have definite ad- 
vantages. 

It may be concluded that the major instrument 
for data collection for scientific survey purposes 
should be some type of form consisting of closed 
questions. However, the inclusion of two or more 
open questions should be considered seriously* 
At times the information resulting from the open 
response will provide a general framework for 
the examining physician to understand other in- 
formation in the medical history. This may save 
considerable time which might otherwise be wast- 
edinfollowing up fruitless leads of specific symp- 
toms. Further, the open question provides a gen- 
eral perception of how the respondent sees him- 
self. This kind of information can at times be 
very useful in interpreting more specific re- 
sponses on the questionnaire, 

A final reason for including open questions 
is more relevant to the public relations aspects 
of a survey than to its research aspects, but is 
a serious consideration. If the respondent has 
something bothering him which is not covered in 
the general history he wants to report it. For ex- 
ample in the field interviews several times after 
the interview the respondent said, often with some 
indignation, 11 But you never asked me about my 
• » • • That f s what really troubles me. Don't you 
want to know about that? 1r 


effectiveness of the self-administered and 

THE CLOSED-INTERVIEW PROCEDURES 


Another major objective of this study was to 
determine whether it is feasible to use a self-ad- 
ministered -questionnaire form to obtain reports 


of symptoms and illnesses. In this section the 
self -administered and the closed interview are 
compared as to the amount of information ob- 
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tained. Since the self-administered form used is 
also of the closed-question type this comparison 
is between two different closed question proce- 
dures— one self -administered and one interview- 
er-administered. The questions are virtually 
identical on the two forms and a direct comparison 
can be made. 

The research design was such that 64 re- 
spondents were given both the closed interview 
and the self -administered questionnaire. Half of 
them took the self-administered form first, fol- 
lowed by the closed interview one to two weeks 
later. The other half were given the two forms in 


reverse order; the interview first, and then the 
self -administered form. 

By cross tabulating the reports for each re- 
spondent, it is possible to find the number who 
reported a particular symptom or illness on one 
or both forms. These tabulations give a picture 
of the efficiency of the two forms in obtaining in- 
formation. An index number (which may be called 
an index of efficiency 1 ) was computed for each 
item. 

Table 13 gives the data from the two forms 
for the 12 major symptoms under investigation. 
The information in table 13 indicates that both 


Table 13. Comparison of symptoms on the closed- interview and self-administered form for 

the same responsents* 


Symptom 


Swollen ankles 

Backaches- 

Trouble breathing--- 
Chest or heart pains 

Heart acts funny 

Headaches 

Noises in ears 

Joint pains 

Joint stiffness 

Joint swelling- 

Nosebleeds 

X,eg cramp s or pains - 


Total 

number 

of 

persons 

report- 

ing 

symptoms 

on 

either 

form 


Number 
reported 
in in- 
terview 


Number 
reported 
on self- 
admin- 
istered 
form 


Index of 
efficiency 


Inter- 

viewer 

form 


Self- 

admin- 

istered 

form 


5 

25 

4 
9 

13 

29 

9 

21 

13 

5 

8 

18 


5 

18 

2 

8 

12 

29 

9 

13 

8 

4 

5 
15 


5 

19 
3 

6 

9 

27 

7 

20 
9 
3 
7 

13 


10.0 

7.2 

5.0 
8.9 

9.2 
10.0 
10.0 

6.2 
6.2 

8.0 
6.2 
8.3 


10 .0 

7.6 

7*5 

6.7 

7.0 
9 .3 

7.8 
9 .5 
7 .0 

6.0 

8.8 

7.2 


* 


NOTE; Each row Is based on 64 Interviews with 32 persons. 

ministered questionnaire and the interview. One half 
the other half had the Interview first. 


Each respondent received both the se I f — ad 
had the self-administered form first and 


*lhdex of efficiency Number of reports of symptom on interview _ 

of Interview “/Number reported\ . /Number reported on\ + /Number reportod\ 

\ on both forms } \ self-admln. only ) \ on Inter, only/ 

Index of efficiency Number of reports of symptom on salf-admlnistered form 
of self-admln. “/Number reported\ , /Number reported on\ /Number reported \ 
form [ on bo th forms ) + [ self-admin, only j + \ on Inter,, only/ 
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forms were about equally efficient in obtaining re- 
ports of symptoms. The over -all average index 
of efficiency for the 12 symptoms in the table was 
7.9 for the interview and 7.8 for the self-admin- 
istered questionnaire. 

The two methods yielded remarkably similar 
distributions of reported symptoms. However, 
neither form was successful in picking up all the 
positive responses. Both obtained approximately 
80 percent of the total number reported. In other 
words, if it can be assumed that a report on either 
form indicated the actual existence of a symptom, 
then if 100 people had a certain symptom , an aver- 
age of 80 people would report it on one form and 
an average of 80 on the other. Neither form would 
obtain a positive response from all 100. 

For each major symptom two probe questions 
were asked: "Does this usually happen every few 
days or not as often as that?" and "When this 
happens does it bother you just a little or quite a 
bit?" In cases where a symptom was reported on 
one form and not on the other, it was usually re- 
ported as occurring infrequently and to "bother 
just a little." This result suggests that the probes 
should be included In any efficient medical-histo- 
ry-taking procedure, and that the severity and fre- 
quency indications should be taken into consider- 
ation in the evaluation of the symptom report. 

Table 14 shows a comparison of clusters of 
symptoms of particular diseases reported on the 
closed-interview and on the self- administered 
form. The results are similar to those seen in 
table 13; neitherform obtained a complete report, 
and neither was particularly more successful than 
the other. The number of symptoms of all types 
reported was 4.5 per personfor the closed-inter- 
view and 5,1 for the self -administered form. 

Table 15 gives comparable information for 
illnesses. The indices of efficiency show greater 
variability, probably because of the low preva- 
lence of each illness. Because of the small num- 
bers reported for each illness , these data must 


be interpreted with caution. About the only con- 
clusion one can make is that there is no evidence 
that the closed-interview had substantially greater 
success in obtaining reports of illnesses than the 
self -administered form. 

However, for the common childhood diseases 
with a large volume of reported conditions there 
is a noticeable superiority of the interview. The 
average number of childhood diseases reported 
on the self -administered form Was 3.0 and on the 
interview, 3.5. The interviewer's presence was 
apparently helpful in obtaining full answers to 
these questions. Interviewers found that ques- 
tions on childhood diseases gave the respondents 
trouble because they could not remember accu- 
rately , or because they did not know how to report 
the information they possessed. The interviewer 
was able to use his skills in probing to clarify the 
information to obtain a more complete report. 

Conclusions on 

Use of Self-Administered and 
the Closed-Interview Procedures 

It may be concluded that there Is no marked 
evidence that the interviewer -administered form 
shows superiority in obtaining reports on the num- 
ber of present symptoms and illnesses, but there 
is some slight evidence that the interviewer-ad- 
ministered form is more successful than the self- 
administered form in investigating childhood ill- 
nesses, particularly minor ones. It might be con- 
cluded that a self-administered form can be used 
effectively for symptoms and illnesses, with the 
exception of the common diseases of childhood. 

For each symptom and illness, several probe 
or follow-up questions were asked in the inter- 
view. These probes were described earlier and 
were included* to provide some evaluation of and 
insight into the reports. Two of the probes, on 
frequency and duration, could be formulated so 
that they could be included in the self-adminis- 



Table 14, Comparison of clusters of symptoms reported on the closed- interview and on 

the self-administered forms 


Symptom 

Total 

number 

of 

persons 

report- 

ing 

symptoms 

on 

either 

form 

Number 
reported 
in in- 
terview 

- — 

Number 
reported 
on self- 
admin- 
istered 
form 

Index of 
efficiency 

Average number of 
reported symptoms 
per person 

Inter- 

viewer 

form 

: Self- 
admin- 
istered 
form 

Inter- 

viewer 

form 

Self- 

admin- 

istered 

form 

Heart 

51 

46 

40 

9.0 

7.8 

1*4 

1.2 

Rheumatism and 








arthritis 

61 

44 

51 

7.2 

8.4 

1.4 

1.6 

Eiigh blood 








pressure 

43 

21 


4.9 

9.3 

0.7 

1.2 

Miscellaneous-- 

41 

34 

32 

8.3 ' 

7.8 

1.0 

1.1 


NOTE: Each row is based on 64 interviews with 32 persons, Each respondent received both the self-ad- 
ministered questionnaire and the Interview. One half had the se I f-admi n i stered form first and 
the other half had the Interview first, 


Table 15. Comparison of number of reported disorders on closed- interview and self-ad' 

ministered forms 


Disorder 


Index of 
efficiency 


Total 

number 

of 

persons 
report- 
ing dis- 
orders 
on 

either 

form 


Number 
reported 
in in- 
terview 


Number 
reported 
on self- 
admin- 
istered 
form 


Inter- 

viewer 

form 


Self- 

admin- 

istered 

form 


Allergy 

Chest trouble 

Heart trouble 

High blood pressure-- 

Hemorrhoids-- 

Hernia -- 

Kidney or bladder trouble 

Nervous breakdown 

Rheumatism or arthritis-- 
Varicose veins — 


NOTE: Each row is based on 64- Interviews with 32 
ministered questionnaire and the Interview, 
the other half had the Interview first. 



3.3 

6.7 

10.0 

2.5 

5.0 

10.0 

5.0 

5.0 

10.0 

7.0 

10.0 

5.7 

8.0 

10.0 

6.7 

10.0 

7.3 

8.2 

8.3 

8.3 

J both 

the se 1 f— ad- 


persons, Each responaeni reoe 

One half had the se I f-adml n I stered form first and 
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tered form. Other probes, however, could not 
practically be phrased so that they couid be 
answered ‘ with checkmarks. For example the 
probes, "Tell me how it feels/' or " What do you 
think causes this?" require the presence of the 
interviewer to record the responses and to do 
additional probing where necessary. 

For this reason it is not feasible to make the 
questionnaire completely self-administered. The 
positive responses should be followed up by an 
interviewer, using the specified probes. 

Respondents’ Report 
of Causes of Symptoms 

For each major symptom which the respondent 
reported, he was asked what he thought caused 
the symptom. This probe was included because 
symptoms have different medical significance de- 
pending upon the origin of the symptom. While 
it was not expected that the respondent could be 
an expert diagnostician, it was possible that he 
might have information which would provide added 
insight into the reported condition or symptom. 
Statistical tabulations of the reported causes, on 
this small number of cases, are not meaningful. 
However, a listing of some of the types of reasons 
given for symptoms of high incidence is inter- 
esting. In the list below, the order of listing of 
the causes gives a rough index of frequency of 
mention with 1 meaning 10 or more mentions; 

2 meaning 5 to 9 mentions; and 3 meaning 3 to 5 
mentions. Respondents frequently reported more 
than one 1 'cause/ 1 
Reported causes of headac hes 

1. Worry, tension, "nerves 11 
Associated with eye strain, not wearing 

glasses, etc. 

Sinus infection 

2. "Female troubles" 

Stomach disorders 


3. Irregular meals 

Overindulgence in alcohol 
Reported causes of backac hes 

1. "Female troubles" 

2. Associated with rheumatism or arthri- 

tis 

Physical strains, due to working con- 
ditions or overactivity 
Underactivity, "not enough exercise/' 
"just sit around all day/ 1 etc, 

3. Caused by a specific accident or injury 
Pregnancy 

Reported causes of noseble eds 

2, Associated with upper respiratory 
disorders 

Reported causes of noises in ear s 
2, No idea what causes it 
3 b Respiratory disorders 
Reported causes of chest or heart p ains 

1. Associated with stomach and other 

digestive troubles 

2. Respiratory disorders 

3. "Nerves/ 1 tension or worry 
Reported causes of heart acting fun ny 

1, Nerves, tension, or worry 

2, Don T t know the cause 

3, Heart trouble 
Overexertion 

Reported causes of joint p ains or soreness 

1, Associated with rheumatism or arthri- 

tis 

2, Due to climate 
Respiratory disorders 

Many of the causes attributed to the symptoms 
may not be particularly meaningful or helpful to 
the physician as an aid to diagnosis. In some 
cases, however, responses were sufficiently spe- 
cific to be useful in helping to understand the im- 
port of the symptom. As a time-saving aid to the 
examining physician, this probe could be included 
for selected symptoms or conditions. 



SUMMARY OF CONCLUSIONS 


After both qualitative and quantitative analy- 
sis of the data, the following conclusions may be 
stated in regard to the major objectives of this 
research project: 

1, People generally were found to be most 
willing to discuss their symptoms and illnesses 
with either nurses or nonmedical trained inter- 
viewers. 

2, It is feasible to construct .a idard set 
of questions and probes to be administered with 
standardized techniques to elicit information about 
symptoms and illnesses, 

3, On most items the reliability of two re- 
ports taken a week or two apart was high, al- 
though for some symptoms, such as stiffness in 
joints and backaches, reliability dropped consid- 
erably, 

4, Trained lay interviewers were as suc- 
cessful as nurses who were trained in interviewing 
in getting respondents to talk about their medical 
problems; they obtained reports of equally high 
frequency of symptoms and disorders. There was 


some evidence that trained lay interviewers ob- 
tained greater frequency of responses to symp- 
toms than did nurses in uniform. 

5. The self -administered form of the ques- 
tionnaire obtained about the same frequency of 
symptoms as did the closed-interview form. It 
also obtained about the same reported frequency 
of illnesses. However, the interview was neces- 
sary for follow-up probes as to the perceived 
cause of the symptom. Interviewer participation 
was particularly important in probing some of the 
details of illnesses. The open -interview ques- 
tionnaire obtained considerably lower frequencies 
for the symptoms which were asked about specif- 
ically in the closed -interview questionnaire. The 
evidence is that the symptoms reported in re- 
sponses to the open questions were those which 
bothered or concerned the respondent most. Open 
questions also permitted the respondent to give in- 
formation on the background of the symptom. His 
fuller description might give greater insight into 
the significance and importance of the symptom. 



